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Abstract. It is shown by Karp reduction that deciding the singu- 
larity of (2™ — 1) x (2™ — 1) sparse circulant matrices (SC problem) 
is NP-complete. We can write them only implicitly, by indicating 
values of the 2 + n(n + l)/2 eventually nonzero entries of the first 
row and can make all matrix operations with them. The positions 
are 0, 1, 2* + 2 J . The complexity parameter is n. Mulmulcy's work 
on the rank of matrices [5] makes SC stand alone in a list of 3,000 
and growing NP-complcte problems. 



I. Introduction 

It is proved that calculating the singularity of sparse circulant ma- 
trices (SC) is NP-complete. "Sparse" in our context means that only 
entries 0, 1, 2 % + 2 J of the first row are eventually nonzero. The other 
rows are defined from the first one. In the next section we define 3 
problems MQ, PQ, SC. MQ is a well established one. Our polynomial 
time reductions are MQ =>- PQ => SC. The reduction MQ =^> PQ has 
already been established by Kipnis and Shamir ([3], Section 3.) We 
give another proof in Appendix [Bl In the main body of this paper we 
deal with PQ SC. 

Most of the known 3000 and counting NP-complete problems are re- 
wording of each other, iterative, or just variations of exhaustive search. 
Mulmuley [5] has proven that calculating the rank of a matrix is none 
of the above, so SC holds a special place among all NP-complete prob- 
lems. We can make nearly any (counterexamples exist) assumption on 
the shape of n and the problem remains NP-complete. The commuta- 
tive ring (Mjt, +, •) of k x k matrices over a finite field is mathematically 
exceptionally rich. Matrices are very sparse, circulant, symmetric. We 
believe that SC has the potential to simplify the Complexity Zoo. 

To the best of our knowledge, no previous work has been done in 
this direction. There exist very few NP-problems mentioning matrices, 
like MinRank, MaxRank, Sing [1] but they are of a completely different 
nature. In MinRank e.g., we are given a matrix with part of the entries 
from a ring and part variables that assume values in that ring. The 
question is to find the values of the variables for which the matrix has 
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the least rank. Here we are given all the entries of the matrix and ask 
whether the determinant is 0. 

In the third section we prove that SC is NP-hard. In the fourth we 
provide SC with a certificate for yes answers to any instance. This 
completes the NP-completeness proof. In fifth and sixth sections we 
give considerations on the present state of things and possible paths to 
follow. In appendix A we give an illustration of the algorithm of the 
fourth section. In appendix B we give another proof of MQ =>- PQ. 

2. Statement of the Problems 

Let's start by stating the two problems, one novel and one classic. 
We solve the classic NP-complete problem in polynomial time using as 
a subroutine the novel problem, and this proves the NP-hardness of 
the novel problem (Karp reduction.) 

2.1. MQ (Multivariate Quadratic). 
Definition 2.1. A term is a monic monomial. 

2.1.1. Instance. [2] Polynomials Pi[xi,X2, • • - x n ], 1 < i < m, from the 
ring F 2 [xi, x 2 , • • • , x n ] of multivariate polynomials with coefficient in 
the field Z/2Z. 

2.1.2. Question. Do there exist u±, u 2 , ■ ■ ■ , u n G {0,1} such that, for 
1 < % < m, Pi[ui, u 2 ,... u n ] = 0? 

2.1.3. Comment. Remains NP-complete even if none of the polynomi- 
als has a term involving more than 2 variables, that is, all polynomials 
are quadratic. Easily solved in polynomial time if no term involves 
more than 1 variable, that is, all polynomials are linear, or if there is 
just one polynomial. Variant in which the U\ are allowed to range over 
the algebraic closure of ¥ 2 is NP-hard, even if no term involves more 
than 2 variables. It is easy to prove that the problem remains NP- 
complete for all characteristics and if m, n are polynomially related. 
By this case we can always assume that m = n. If m > n, we can as- 
sume that (m — n) variables are there and just don't appear. If n > m 
we can count the last equation {n — m) times. 

2.2. PQ (Pseudoquadratic). 

Definition 2.2. A polynomial P{x) as below with coefficients from 
some field ¥ q is called pseudoquadratic. 

n—l n—1 

(1) p(x) = j2 a ^ 2i+2j+ J2 b ^ 2i + c 

i,j=0 i=0 

In characteristic 2, P(x) has 2 + n{n + l)/2 terms. It is rather 
sparse and writable in 0(n 2 ) space. The degree of P(x) is at most, and 
generally equal to, (2"" 1 + 2™~ 2 ). 
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2.2.1. Instance. ([1], Section 3) A polynomial P(x) G F 2 n[x] over the 
field F 2 n. 

2.2.2. Question. Does there exist u G F 2 n such that P{u) = 0? 

2.2.3. Comments. Transformation from MQ ([1], Section 3). Remains 
NP-complete for a variety of generalizations that fall out of the scope of 
this paper. Not known to be NP-hard or NP-complete for P(x) having 
just 3 terms. Trivially solved in polynomial time if it has 2 terms. It's 
trivial to bring MQ to PQ to MQ in polynomial time 

2.3. SC (Sparse Circulant). 

Definition 2.3. A nxn circulant matrix is a matrix whose row number 
k is obtained by left shifting the zeroth row (aoo, clqi, ^02, • • • , Oo,(n-i)) by 
k positions. That is, a^j = a 0i {(j+j) mo dn}- 

The other equivalent definition is by shifting right. This one has 
the nice property that the matrix is symmetric. Two more equivalent 
definitions by columns. 

Definition 2.4. Here a sparse circulant matrix is a (2™ — 1) x (2™ — 1) 

circulant matrix with 2 + n(n + l)/2 nonzero entries in the first row, 
located in the positions 0, 1, 2 l + 0? . 

2.3.1. Instance. A (2 n — 1) x (2 n — 1) sparse circulant matrix with 
entries from the finite field F 2 n. 

2.3.2. Question. Is the matrix singular? 

2.3.3. Comment. Evidently, it takes exponential space in n (the com- 
plexity parameter) to write the matrix explicitly. We assume writing 
it implicitly, by giving the nonzero entries of the first row. This is no 
hassle for performing the necessary matrix operations. 

It is not known whether the problem remains NP-complete if the 
nonzero entries are just 3. Easily solved in polynomial time if the 
nonzero entries are 2. 

3. PQ IMPLIES SC, OR SC IS NP-HARD 

We take it from Kipnis and Shamir ([1], Section 3) that PQ is NP- 
complete. We bring PQ into SC in polynomial time by Karp reduction, 
that is, we'll solve PQ in polynomial time using SC as a subroutine. 

We have 

(2) {P(x) has roots in F 2 n} <<=> {Res{P{x),x 2 " - x) = 0} 

The Sylvester matrix associated with resultant Res(P(:c), x 2 " — x) is 
not circulant at all, we transform it into one with the same singularity. 
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3.1. Prom Sylvester to circulant matrix. 

Definition 3.1. Let c = (co, ci, c 2 , . . . c m _i)' be a column vector and 
f 7^ a scalar. Zj m ^ n [c) = (zij) is called an f -circulant m x n matrix 

if %ij Ci—j mod m JOT % ^ j and Zj_j /Cj_j mo d m JOT % <C j . 

For / = 1 it is circulant and for f = — 1 anticirculant. 

For illustration of our steps, take n — 3, F 2 « = F 2 3 and a polynomial 
of degree k < 2 n with coefficients in it, = a 5 x 5 +a 4 x 4 +a3X 3 +a 2 x 2 + 
aix + a , not necessarily sparse. Res(x 2 ™ — x,p(x)) is the determinant 
of the (2 n + k) x (2 n + fc) Sylvester matrix in ©. 
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The case ao = is trivial, assume ao 7^ 0. The last column has only 
one nonzero entry. The singularity does not change after erasing the 
last column and row. 

In (j3J) add column i to column (2 n + i) for 1 < i < k, and get (@J. 
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In the first k rows of (OS) there is only one nonzero entry per row. 
Singularity does not change after erasing the first k rows and columns. 
We're left to find the singularity of the (2 n — 1) x (2 n — 1) circulant 
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matrix in the right down square of (jl]). This proves that SC is NP- 
hard. In order to finish the proof we must prove that given a yes 
instance of SC (the determinant is 0) we can provide a proof, verifiable 
in polynomial time. 

4. The yes Answer is Verifiable in Polynomial Time, or 

SC is NP-COMPLETE 

To a system S of n quadratic equations in n variables we have asso- 
ciated the corresponding pseudoquadratic polynomial P, and to it the 
corresponding sparse circulant matrix M (jlj). We'll write Ps(x),Mp 
and so on for the associated objects. 

(5) (| M | = 0) -v^ (Pm has solutions) <^> (Sm has solutions)) 

If we have a subroutine that finds out that \ M\ = 0, we are able to re- 
cover a solution (all solutions if their number is polynomially bounded) 
of the associated polynomial Pm(x) and of the associated system Sm- 
Each of these solutions works as a certificate: " | M | = because 
Pm(xo) = 0." A solution to Pm(x) can be verified in polynomial time. 
Same is true for a solution of Sm- We'll use Sm in the generation of 
the certificate because it's technically easier. 

It seems a little bit odd to work with M and then for the proof of 
singularity regress to the problems we started from, but why not? It 
might be easier to guess the singularity of M rather than guess whether 
Sm has solutions, and then return to Sm for the certificate. Next we 
give an algorithm for recovering all solutions of Sm in polynomial time 
using as a subroutine the singularity of M and ignoring the complexity 
of M. 

4.1. Producing a certificate. All we're left to do is produce a solu- 
tion to Sm given \ M\ =0. Recall from (jHJ) that Sm has a solution iff 
\M\ = 0. 

By an argument of padding with zeros accordingly as in appendix [B] 
we can assume to have as many equations as variables in all systems 
we'll deal with, though the number of variables decreases by 1 per 
iteration and the number of equations typically remains constant. 

We build a sparse binary tree whose nodes are systems derived from 
Sm- In this section drop the index M for simplicity. The empty string 
is A. The fc-bit string i = ■ ■ - ik is the index of the system Sf 

obtained from S by substituting Xu = ij. The children of S 1 ^ -1 are S^ 
and Sf t . The depth of is k. The ij means "juxtapose strings i and 
j" 

Every yes node in Algorithm ( 14. ip will lead to at least one solution. 
It might bifurcate but cannot extinguish. If there are s solutions, in 
any depth k we can't have more than s yes-es. In the depth (k + 1) we 
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Algorithm 1 Solving MQ using SC as a subroutine 



k — 0; Si — S; check whether \ M s o \ is 0, yes or no ; 
while k < n do 

for every yes node do 

write S^ 1 , Sf^ 1 ; comment : construct the two children of Sf 

check whether I M Q k+i I and I M Q k+i I are 0, yes or no ; 



od ; 

£; + +; 

od ; 

return the indices of the yes nodes ; 



can't have more than 2s nodes altogether. This yields the non-sharp 
upper bound for the number of nodes, 2ns. 

Let's assume that writing down S takes 0(n 3 ) space. So, making 
one substitution is 0(n 3 ). We need 2ns substitutions and the com- 
plexity becomes 0(sn 4 ). At every substitution we have to check the 
singularity of the associated matrix. If M is the complexity of check- 
ing once, 0(sn 4 + snM) is the overall complexity of the algorithm. 
We found all the solutions in polynomial time. This ends the proof of 
NP-completeness. 

5. Conclusions 

By the argument of padding with zeros as in appendix [B]we can make 
nearly every assumption about the shape of n and the problem remains 
NP-complete. Experimentally our determinants do behave differently 
for different shapes of n and this might be relevant. We've not yet been 
able to take advantage of it. 

There are many ways to decide the singularity of sparse circulant 
matrices, the most promising of them all being Mulmulay's [3]. Or 
we can check whether are there any zero eigenvalues. Calculating only 
one of them is rather inexpensive. There are (2™ — 1) eigenvalues, 
checking them all is once exponential in n. We may check the number 
of linearly independent rows or columns. In general it comes down to 
Gaussian elimination, which here is exponential in n. We haven't yet 
taken any advantage of the special sparseness of our matrices and of 
other structure in them. Because (2 n — 1) is odd, there always exist the 
(2™ — l)th primitive roots of unity. Fast Fourier Transform methods 
apply. All these constructions work for all characteristics, with few 
adaptations. 

It was proved that the problem of deciding the singularity of sparse 
circulant matrices is NP-complete. This is the first NP-complete prob- 
lem of the kind. An even more interesting feature is their potential for 
further improvements of complexity. 
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None of algorithms mentioned here for calculating the singularity 

• is novel or 

• takes advantage of 

— the sparsity, 

— the being circulant and symmetric, 

— the fact that the ring of circulant matrices is commutative, 

— the shape of n, 

— deciding the singularity, as opposed to the determinant, 
rank or eigenvalues. 

Further exploration of the topic is needed to clarify how much the 
complexity can be reduced with specially designed algorithms that take 
advantage from the very special structure, and whether that has any 
theoretical impact. 
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Appendix A. Example of Solving MQ in Polynomial Time 



For illustration of the Algorithm HJ] only, let's have the trivial system 
S of 26 equations in 7 variables, which was generated in Singular [3]. 



References 



Given SC 



t 3 t 7 + t 7 
(6) t 2 t 7 + 1 7 

ht 7 + 1 7 

tst e + £ 6 + £ 5 + 1 

hU + h + t G + i 





The execution of Algorithm 14.11 gives the tree in Figure ??. The 
yes nodes are marked with * and are easy to guess from the graph 
anyway. We find the solutions 0010010, 1110100 and 1110101 over F 2 . 
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Some solutions are multiple but it doesn't matter in this argument. 
The complete tree has 2 7 = 128 leaves, here we have only 14. 

Appendix B. The Transformation From MQ to PQ 

Let's have a system S of m equations in n variables. By giving to 
all variables x\, x 2 , x%, ■ ■ ■ x n all possible values we define a function 
(F 2 ) n — > (F 2 ) m . After eventually padding in the end either one of the 
strings n, m bit long, we can assume that m = n. The old elements of 
(F 2 ) m identify canonically with the ones that end with (n — m) zeros. 
If n > m, we can keep the function as it is, sending nothing to the 
new elements. If n < m we add (m — n) variables and no equations 
for them. Canonically the new elements go to the (F 2 ) m element where 
goes the element to whom they're extensions. 

So, the system S defines a function (F 2 ) n — ► (F 2 ) n which induces a 
function F 2 n — > F 2 n. Every function in a finite field F 2 ™ is alternatively 
defined by a polynomial from F 2 ™ [x] . If it has t monomials to which we 
know the terms but not the coefficients and t is small, we need only t 
evaluations to get it by interpolation. 

We have put in one-to-one correspondence each system of quadratic 
equations with a univariate polynomial with the property that every 
string that is a solution to the system is also a solution to the univariate 
polynomial, first considered as element of (F 2 ) n and then as element of 

¥ 2 n. 

In this shift from multivariate systems to univariate polynomials, to 
the quadratic systems of equations correspond pseudo quadratic poly- 
nomials ([1], Section 3), or polynomials of the form (CQ). 

An alternative and constructive proof of this fact comes from the 
process of expanding a given univariate polynomial into a system of n 
equations in n variables. It's obvious that the correspondence between 
univariate polynomials P(x) over F 2 ™ and systems Sp of n equations 
in n variables over F 2 is one-to-one. when expanding a term x d of P(x) 
we get as many linear factors as the Hamming weight of d. The biggest 
Hamming weight will be the degree of the system. (This argument 
holds only for base field F 2 .) On pseudoquadratic polynomials it is by 
definition 2. 
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